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(57) Abstract: A method of returning to a program that is being received on a first channel is disclosed. The method includes storing 
data that characterizes at least one portion of the program. After storing this data, the user is free to change channels. The system 
automatically switches back to the first channel when data that characterizes a subsequent portion of the program matches the stored 
data. 



BNSDOCID: <WO 0162002A2_I_> 



WO 01/62002 



PCT/EP01/00514 



Automatic channel selection system 



The present invention relates to an automatic channel-selecting system that 
returns a receiver to a particular channel after the user has tuned away from that particular 
channel. The present invention may be used, for example, to avoid commercials in 
conventional television and radio broadcasts. 

5 

Television commercials are perceived by many people as an annoying 
interruption to their television programs. When a commercial appears, some viewers simply 
wait for the commercials to end, and continue watching the original channel until their 
10 program returns. During this time, however, these viewers will be watching something in 
which they are not interested. 

Other viewers will "channel surf' as soon as a commercial appears, in the 
hopes of finding something that interests them more than the commercial. While these 
viewers may ultimately find something of interest, channel surfers can never be sure when 
15 the original program has returned to the original channel. Thus, when the channel surfer 

returns to the original channel, he may find that the commercials are still running, or that he 
has missed part of his program. Even worse, if the channel surfer gets carried away watching 
a program on an alternate channel, he can miss a large portion of his program. 

20 

WO 99/31879 is an example of a system that eliminates commercials 
automatically by changing channels as a soon as a commercial is detected. But operation of 
this system interferes with the user's control of the system, because the initial departure from 
the original channel occurs automatically. In addition, the user can not explicitly specify a 
25 particular type of content to which the system will later return. 

EP 366001 A2 is an example of a system that provides users with more control 
and allows the users to select a channel that will be automatically returned to after channel 
surfing. It operates by having the user enable a timer before changing channels. In response 
to the enabling of the timer, the system stores the channel being watched. The user is then 
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free to change channels as desired. After a predetermined time (e.g., 60, 90, or 120 seconds), 
the timer times out, and the system automatically switches back to the stored channel. While 
the EP 366001 A2 system prevents users from being carried away watching an alternate 
program, it cannot correct the problem of returning a viewer to the original channel to soon 
5 or too late, since the decision to return to the original channel is based on elapsed time. A 
solution that would return the viewer to the original program only when the commercial has 
actually ended would be highly desirable. 



10 It is an object of the inventor to provide an improved channel selection system. 

To this end, the invention provides an automatic channel selection as defined in the 

independent claims. The dependent claims define advantageous embodiments. 

The present invention enables a user to store data that characterizes a portion 

of a program, and to subsequently change channels as desired. When data that characterizes a 
15 subsequent portion of the program matches the stored data, the channel switches back to the 

original program. 

More specifically, in one embodiment, while the user is watching or listening 
to a first program that is being broadcast on a first channel, the user indicates interest in the 
first program either explicitly (e.g., by pressing a button) or tacitly (e.g., by measuring dwell 

20 time). After the indication of interest, the user is free to change channels as desired, and to 
watch or listen to other programs. Meanwhile, the system monitors the original channel. 
When content that matches the first program reappears on the first channel, the system 
automatically reverts to the first channel. 

One aspect of the present invention relates to a method of returning to a 

25 television program being received on a first channel. The method includes the steps of 

accepting a storage command from a user, and storing data that characterizes the program in 
response to the storage command. The user is then permitted to change channels. After the 
user has changed channels, the method detects when data that characterizes a second portion 
of a broadcast on the first channel matches the stored characterizing data. When a match is 

30 detected, the television is returned to the first channel. 

Another aspect of the present invention, which is not limited to television, 
relates to a method of returning to a first program being received by a receiver via a first 
channel. The method includes the steps of accepting a storage command from a user, and 
storing data that characterizes the program in response to the storage command. The user is 
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then permitted to change channels. After the user has changed channels, the method detects 
when data that characterizes a second portion of a broadcast on the first channel matches the 
stored characterizing data. When a match is detected, the receiver is returned to the first 
channel. 



Fig. 1 is a hardware block diagram for a preferred embodiment of the present 

invention. 

Fig. 2 is a diagram of a remote control keypad arrangement used with the Fig. 

10 1 embodiment. 

Figs. 3A-3D illustrate the filtering of a segmented image to derive a feature 
vector precursor. 

Figs. 4 and 4 illustrate Delaunay triangulation and Voronoy diagram stages in 
an image filtering step in an image classification process according to an embodiment of the 
1 5 present invention. 

Figs. 5A and 5B illustrate an angle histogram-type feature space according to 
an embodiment of the present invention. 



20 The embodiment illustrated in Fig. 1 includes a main tuner 30 that is 

preferably supplied with a composite multi-channel signal from a signal source such as an 
antenna 33. Examples of suitable composite multi-channel signals include a superposition of 
a plurality of radio frequency transmissions arriving at the antenna 33, or the superposition of 
a plurality of video signals, each modulated by a different carrier, on a cable (not shown). 

25 An audio/video (A/V) output of the main tuner 30 is provided to the monitor 

31. Preferably, the monitor 31 displays the video information on a suitable output device such 
as a cathode ray tube, liquid crystal display panel, plasma display panel, thin film transistor 
panel, light emitting diode array, or the like. In addition, the monitor 31 converts the audio 
portion of the audio/video signal from the main tuner 30 into sound that can be perceived by 

30 an observer (using, e.g., an audio amplifier and speakers). Details of implementing the main 
tuner 30 and the monitor 31 are well known to persons skilled in the relevant arts. 

A controller 20 controls the operation of the entire system, preferably by 
implementing the process steps described below in connection with FIGS. 3 and 4. The 
controller 20 may be implemented using a microprocessor cooperating with a program-store 
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memory and random access memory (not shown). The implementation of such 
microprocessor-based controllers is well known to persons skilled in the relevant arts. 
Alternatively, the controller 20 may use hard-wired logic to implement the process steps 
described below in connection with Figs. 3 and 4. 
5 Preferably, the controller 20 receives command codes 25a from a remote 

control unit 25. Fig. 2 illustrates a suitable keyboard arrangement for the remote control 25. 
The command codes 25a may be transmitted from the remote control 25 to the controller 20 
using any suitable approach including, for example, transmitting a unique sequence of 
infrared pulses from the remote control 25 to the controller 20 in response to the pressing of 

10 each key 26. 27a-27d, 28a-28b on the remote control 25. A wide variety of alternative 
arrangements for implementing control of the controller 20 can be readily envisioned, 
including, for example, using radio frequency or ultrasonic transmissions, or a wired 
connection between the remote control 25 and the controller 20. 

The hardware configuration of the remote control 25 itself is preferably similar 

15 to the hardware configuration of conventional remote control units. Any suitable arrangement 
of conventional remote control keys may be included on the remote control 25. For example, 
the illustrated remote control 25 includes control buttons for power 27a, mute 27b, volume up 
and down 27c-d, and channel up and down 28a-b. 

Returning now to Fig. 1 , when the controller 20 receives a command code 25a 

20 from the remote control 25 that corresponds to any of the conventional remote control 

buttons 27a-d, 28a-b the controller 20 sends appropriate commands to the main tuner 30 or to 
the monitor 31 to carry out the command requested by the user. For example, to change the 
channel on the main tuner 30, the controller 20 would send a suitable main channel control 
signal 20a to the main tuner 30. Details of implementing a tuner than can be tuned by 

25 applying a channel control signal are well known to persons skilled in the relevant arts. 

Similarly, to change the volume on the monitor 31, the controller 20 would send a suitable 
volume control signal (not shown) to the monitor 31. 

In addition to the conventional command keys 27a-d, 28a-b, the remote 
control 25 also includes a remember button 26, which is used to actuate the remember mode. 

30 When the remember button 26 on the remote control 25 is pressed, a unique command code 
25a corresponding to the remember button 26 is sent from the remote control 25 to the 
controller 20. Operation of the controller 20 upon receipt of this remember command code is 
described below. 
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The preferred hardware configuration also includes an auxiliary tuner 40. The 
input signal for the aux tuner 40 may be provided by its own antenna 43 or cable (not 
shown), or via the same antenna 33 or cable that is used for the main tuner 30. The controller 
20 preferably selects the channel to which the aux tuner 40 is tuned using the aux channel 
5 control signal 20b, preferably in a manner similar to the main tuner 30. 

The audio/video output 40a of the auxiliary tuner 40 is provided to the 
fingerprint memory 41 and the fingerprint compare unit 42. Optionally, although not so 
illustrated, the fingerprint memory 41 and the fingerprint compare unit 42 may be 
implemented in software in the controller 20. 

10 When the fingerprint memory 41 receives a store command 20c from the 

controller 20, the fingerprint memory 41 will store a "fingerprint" of the A/V signal 40a. This 
"fingerprint" characterizes or classifies the A/V signal 40a at the time the store command was 
received, and is ultimately used as a basis for comparing various signals with one another. 
Preferably, signals that are similar will have similar fingerprints, so that the similarity of the 

15 signals themselves can be evaluated by comparing the similarity of the fingerprints. 

Fingerprinting may be implemented based on the video portion of the A/V 
signal 40a using any of a variety of suitable techniques. In one embodiment, the stored 
fingerprint may simply be a block of data corresponding to a single video frame (either black 
and white or full color), which is captured and stored in a suitable memory when the store 

20 command 20c is received. In another embodiment, the stored fingerprint may comprise video 
data for a plurality of video frames. 

In more preferred embodiments, the fingerprints contain less information than 
the original signal, so that less processing power will be needed to make fingerprint 
comparisons. For example, the frame data in the above-described embodiments may be 

25 compressed, or the fingerprint may be based on a motion detection analysis of the differences 
between temporally separated frames to determine a characteristic type of motion. In other 
embodiments, a function that characterizes either a single video frame or a plurality of video 
frames may be used as the fingerprint. The computed value or values that result when the 
function is applied to the inputted video frame or frames may then be stored as the fingerprint 

30 in the fingerprint memory 4 1 . 

One example of a function suitable for this purpose can be found in U.S. 
Patent No. 5,870,754 (Dimitrova et al.), which is incorporated herein by reference, and which 
describes extracting signatures from video clips based on luminance, chrominance, and 
motion vector values. 
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Another example of a suitable function for implementing fingerprinting, also 
developed by Dimitrova, is image isolation. Image bitmaps may be used to generate a shape- 
dependent feature vector, which is applied to a back propagation neural network (BPNN). 
The feature vector provides greater emphasis on overall image shape while being relatively 
5 insensitive to variability problems. In the technique for isolating image regions, connected 
component structures are defined based on the edges detected. Since edge detection produces 
far fewer pixels overall than binarizing the entire field occupied by a symbol, the process of 
generating connected components can be much more rapid. The selection of feature space 
also enhances recognition speed. With simulated BPNNs, the size of the input vector can 
10 seriously affect throughput. Care should be taken to be selective with regard to the 

components used from the selected feature space. Of course, heterogeneous feature spaces 
may be formed by combining mixes of different metrics such as moments and line-segment 
features. Also, computational economies may be realized where the selected features share 
computational steps. 

15 A chosen feature vector is generated by the appropriate image analysis. A 

variety of these can be used. A number of different feature spaces are suitable for use with 
this approach. Examples of some suitable feature spaces, which are size and rotation 
invariant and are considered particularly suitable to video image classification using a BPNN 
classifier, are described in detail below. 

20 As shown in Figs 3A - 3D a first feature space is derived from an original 

image 150 by, for example, forming a binary version 155 of the image 150, locating feature 
points 165-169 of the binarized image 155, and extracting those feature points 165-169 Note 
that while only a small number of feature points are illustrated, a larger number would be 
used in practice. Referring now to FIGS. 4A and 4B, a Delaunay triangulation (FIG. 4A) or a 

25 Voronoy diagram (FIG. 4B) is derived from the feature points 12. An image processor (not 
shown) performs the triangulation and then, for each triangle 1-6, generates an inventory of 
the internal angles. It then uses this inventory to generate a histogram of the angles, as shown 
illustrated in Fig. 5A. The histogram simply represents the frequency of angles A, B, and C 
of a given size range in the set of triangles 1-6 defined by the triangulation. Note that other 

30 triangulation methods or polygon-generating methods can be used. For example, referring to 
FIG. 4B, a set of Vorony polygons 17 and 18 can be used to define a set of angles A 1 , B', and 
C\ each associated with a vertex 14 of the Voronoy diagram. The angle histogram that results 
serves as the feature vector for the particular character from which the features points were 
derived. 
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Other size and rotation invariant features may be added to the above feature 
space, for example, the number of horizontal lines, the number of crossing points, the number 
of endpoints, holes, inflection points, midpoints etc. Another variation on the angle histogram 
is the use of only the two largest (or smallest) of the interior angles of each triangle. Still 
another variation of the angle histogram is to use a two dimensional angle histogram instead 
of the one-dimensional angle histogram. For example, referring to FIG. 7B, the largest (or 
smallest) pair of angles for each triangle defines an ordered pair (ordered by size) for each 
mangle in the Delaunay triangulation (or each vertex of the Voronoy diagram). The first 
element of each ordered pair is used for the first dimension of the matrix and the second 
element, for the second dimension of the matrix. In this way, the association between angles 
is preserved as information for training and classifying using the BPNN classifier. 

Still another feature spaced considered particularly suitable for the video 
image BPNN classifier is an array of size-invariant moments. Each feature vector is applied 
to the trained BPNN which outputs various candidate classes and hopefully, depending on the 
inputs, one very strong candidate. If there are multiple candidate images, a best guess may be 
made by combining the probability output by the BPNN with frequency of use data for a 
presumed context. Such data may be compiled from different types of material, for example, 
television advertising transcripts, printed material, streaming or downloaded files from the 
Internet. One way to combine such data is to weight the probabilities output by the BPNN by 
the corresponding probabilities associated with frequency-of-use statistics. 

The use of numerous alternative functions can be readily envisioned, 
including, for example, locating large blocks of a relatively uniform color in the video frame 
(corresponding, for example, to the grass playing fields of baseball and football fields). 

Turning back to Fig.l, fingerprinting may also be based on the audio portion 
of the A/V signal 40a, or even based on closed-caption information. Preferably, when audio 
fingerprinting is used, the fingerprint is computed based on at least a full second of audio 
information extracted from the A/V signal 40a. Characteristics of this audio information may 
then be stored as the fingerprint. For example, the audio signal may be transformed into a 
plurality of discrete frequency components using a discrete Fourier transform, and the 
resulting frequency components may be used as the fingerprint. Numerous alternative 
functions (e.g., conventional voice fingerprinting techniques) may also be used. 

Once a fingerprint has been stored in the fingerprint memory 41, a fingerprint 
compare unit 42 monitors the A/V signal 40a generated by the aux tuner 40. This monitoring 
uses the same fingerprinting approach used by the fingerprint memory 41. When the 
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fingerprint compare unit 42 detects that the fingerprint of the A/V signal 40a is sufficiently 
similar to the fingerprint stored in the fingerprint memory 41, the fingerprint compare unit 
will send a match-detected signal 42a to the controller 20. 

With most pattern matching techniques, an exact correspondence with the 

5 stored fingerprint is not required to generate a fingerprint match - the fingerprints need only 
be sufficiently similar. For example, in a baseball game, if a fingerprint is stored when a team 
with white uniforms is fielding and two blue-uniformed runners are on base, a fingerprint 
when the blue-uniformed team is fielding would be sufficiently similar to result in a match. 
The pattern matching technique preferably includes a confidence measure that indicates the 

10 probability of a match. When the confidence level exceeds a confidence threshold, a match is 
declared. 

Optionally, the fingerprint compare unit 42 can adjust the confidence 
thresholds as a function of time. For example, because most commercials occur in 30 second 
increments, the fingerprint compare unit 42 can decrease the required confidence measure for 

15 a match detection at 60, 90, and 120 second intervals after the first- channel change, so as to 
increase the probability of detecting a match at those intervals. Alternatively, instead of 
relying on fixed times, the system can learn the expected commercial intervals for a given 
program. The techniques for detecting when the original program has returned to the original 
channel may be combined with conventional commercial-recognizing techniques by 

20 changing the confidence threshold when the commercial-recognizing process determines that 
a commercial is likely to have ended. 

Optionally, the fingerprint compare unit 42 can slowly decrease the confidence 
threshold required for a match as the time from the first channel change increases, so that as 
the commercial lasts longer and longer, it becomes easier and easier to return to the original 

25 channel. 

Optionally, the fingerprint compare unit 42 may check for matches against a 
family of fingerprints, and generate a match-detected signal 42a when any member of that 
family of fingerprints is matched. This may be useful for programs that have multiple sets 
(e.g., the sitcom "Frasier", in which most scenes take place in either the living room, the 
30 kitchen, or the studio). When this option is implemented and the remember button is pressed, 
a fingerprint of the scene is captured and stored in the fingerprint memory 41. A database of 
fingerprint families (not shown) is then checked. If the captured fingerprint appears in the 
database, then the fingerprint compare unit 42 compares the fingerprint of the A/V signal 40a 
to each fingerprint in the captured fingerprint's family. A match-detected signal 42a is 
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generated when the confidence measure for any one of these comparisons exceeds the 
confidence threshold. Thus, when the remember button is pressed when a kitchen scene is 
being broadcast, the system will be able to return to the program even if a studio scene 
appears after the commercial. Optionally, these fingerprint families may include fingerprints 
5 of common opening clips (e.g., an external shot of the space ship in Star Trek). 

A preferred process that may be implemented by the Fig. 1 embodiment, under 
control of the controller 20, responds to pressing of the remember button 26 and the channel 
change buttons 28 on the remote control 25, since the remember button 26 produces a 
remember command, and the channel change buttons 28 produce channel change commands. 
10 In this embodiment, the user is instructed to press the remember button 26 when he wants the 
system to remember a program. 

In a first step, a test is performed to determine if a remember command has 
been received from the remote control 25. If the remember command has not been received, 
processing continues at a next step, where a test is performed to determine whether a channel 
15 change command has been received from the remote control 25. Channel change commands 
are generated by the user by pressing the channel up and channel down keys 28a-b on the 
remote control 25, or by pressing direct entry keypad keys (not shown) on the remote control. 
If a channel change command is not detected, processing returns to the first step. Processing 
will continue to loop through these steps in this manner until either a remember command or 
20 a channel change command is received. 

When a channel change command is detected, processing continues at a step, 
where the channel on the main tuner 30 is changed in accordance with the user's request. 
Preferably, the controller 20 implements this channel change by sending main channel 
control signal 20a to the main tuner 30. The channel presented to the user will then change, 
25 just as it does on conventional TV sets. At this point, the automatic channel return feature is 
not enabled, because the remember key has not yet been pressed. 

If the remember key 26 has been pressed, the test performed in the first step 
will indicate that a remember command has been received, and initialization of the remember 
mode will occur. Thereto the auxiliary tuner channel is set to match the main tuner channel. 
30 Preferably, the controller 20 accomplishes this by issuing an aux channel control command 
20b to the aux tuner 40, as described above. Next, a fingerprint of the A/V output 40a of the 
aux tuner 40 is captured and stored in the fingerprint memory 41. Preferably, the controller 
20 accomplishes this by issuing a store command 20c to the fingerprint memory 41, as 
described above. 
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Once the system has set the aux tuner 40 to the desired channel and stored a 
fingerprint of the desired program, the user is free to change channels as desired. This user 
accomplishes this by pressing the channel change buttons 28. Anytime the user changes a 
channel by pressing a channel change button 28, the remote control 25 will issue a 

5 corresponding channel change command, which is received by the controller 20. 

The controller 20 tests to determine whether a channel change command has 
been received. If a channel change command has been received, the controller 20 changes the 
channel on the main tuner by issuing a main channel control signal 20a to the main tuner 30. 
This causes the channel displayed on the monitor 31 to change in accordance with the 

10 channel change button 28 on the remote control 25 pressed by the user. The user then sees the 
channel changing on the monitor 31 in the same way that it would ordinarily change on an 
ordinary television set. 

Importantly, when the channel setting of the main tuner 40 is changed, the 
channel setting of the aux tuner 40 is not changed, and the aux tuner remains set to the 

15 original channel that was being viewed when the remember button was pressed. Because of 
this, the fingerprint compare unit 42 can monitor the original channel and wait for a 
fingerprint that matches the fingerprint stored in the fingerprint memory 41. 

If, a channel change command is not detected, processing continues at a next 
step where the confidence thresholds are adjusted as required, (e.g., as a function of time, as 

20 described above). Next, a test is performed to determine whether a fingerprint match has been 
detected by the fingerprint compare unit 42. For example, if the remember button was 
pressed while a baseball game was being displayed, the fingerprint stored in the fingerprint 
memory 41 would characterize video or audio components of the baseball game. During 
commercials, the fingerprint of the A/V signal 40a generated by the aux tuner 40 will not 

25 match the fingerprint stored in the fingerprint memory 41, and processing returns to continue 
testing for channel change commands and fingerprint matches. When the baseball game 
returns, however, the fingerprint of the A/V signal 40a will match the stored fingerprint. 
When a match is detected, the fingerprint compare unit 42 will generate a match detected 
signal 42a, and send that signal to the controller 20. Preferably, detection of matches is 

30 inhibited until at least one channel change has occurred, so that a matches will not be acted 
upon before channel surfing has begun. 

When the controller 20 receives the match-detected signal 42a from the 
fingerprint compare unit 42, processing continues at a next step where the main tuner channel 
is set to match the channel setting of the auxiliary tuner 40. Preferably, this is accomplished 
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by having the controller 20 send a main channel control command 20a to the main tuner 30. 
In response to this command, the main tuner 30 (which has been set to a different channel by 
the channel surfing activities of the user) is restored to the original channel that was being 
watched by the user when the user pressed the remember button 26 on the remote control 25. 

In an alternative process that may be implemented using the same hardware 
configuration shown in Fig. 1, instead of waiting until the remember command is received 
before setting the auxiliary tuner channel, the auxiliary tuner channel is set to match the main 
tuner channel each time the channel is changed on the main tuner (i.e., before channel surfing 
begins). 

When the auxiliary tuner channel tracks the main tuner channel before the 
remember command arrives in this manner, the system's response to the remember command 
can optionally be modified to fingerprint the program that was being displayed a certain 
amount of time before the remember button was pressed (e.g., 10 seconds before the 
remember button was pressed). A suitable buffer (not shown) must be provided to store the 
program's fingerprints in anticipation of the remember command's arrival. 

This feature is useful, for example, when a user forgets to press the remember 
button while the desired show was being displayed, and only remembers to do so after the 
show has cut to a commercial. In the first embodiment, pressing the remember button after 
the commercial has started would cause the system to store a fingerprint of the commercial, 
and the system would not be able to return to the desired program. But in this embodiment, 
pressing the remember button 26 on- the remote control 25 causes the system to store the 
fingerprint from the buffer (not shown) into the fingerprint memory 41. This results in the 
storage of a fingerprint corresponding to the actual program being watched (e.g., a baseball 
game). The system can therefore return to that program. 

Optionally, this retroactive remember command may be implemented in 
conjunction with the standard remember command discussed above by, for example, 
providing two buttons on the remote control 25: one for implementing the standard remember 
function, and one for implementing the retroactive remember function. 

In another alternative embodiment, the system tracks the amount of time a user 
has spent watching a given television show (referred to hereinafter as "dwell time"). The 
system interprets the fact that the dwell time has exceeded a predetermined threshold as a 
tacit indication that the user wished to remember a program. This tacit indication replaces the 
pressing of the remember button 26 in the above-described embodiments. When the dwell 
time exceeds the threshold, the system stores a fingerprint, as described above. Optionally, 



0162002A2_I_> 



WO 01/62002 PCT/EP01/00514 

12 

additional fingerprints may be collected as the dwell time continues, and a channel return 
may be executed when any stored fingerprint is subsequently matched. Preferably, 
fingerprints that immediately precede a channel change (e.g. by less than 5 seconds) should 
be discarded to avoid storing a fingerprint of a commercial. 
5 The present invention may be applied to media other than television, such as 

radio and Internet broadcasts. Of course, when an audio-only format such as radio is used, 
only the audio information would be available to implement the fingerprinting storage and 
comparison. The present invention may also be used in picture-in picture systems to switch 
picture windows when a return to the original program is detected. 
10 While the present invention has been explained in the context of the preferred 

embodiments described above, it is to be understood that various changes may be made to 
those embodiments, and various equivalents may be substituted, without departing from the 
scope of the invention, as will be apparent to persons skilled in the relevant art. 
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CLAIMS: 



1 ■ A method of returning to a first television program being received on a first 

channel, the method comprising the steps of: 

recognizing (20) a storage initiation condition while the user's television is 
tuned to the first channel; 

5 storing (41) data that characterizes a first portion of the first television 

program in response to the storage initiation condition; 

permitting (30) the user to tune the user's television set to one or more second 

channels; 

detecting (42), after the user has tuned the user's television to the one or more 
10 second channels, when data that characterizes a second portion of a broadcast on the first 
channel matches the data that characterizes the first portion stored in said storing step; and 

tuning (30) the user's television to the first channel responsively to a result of 
said detecting step. 

15 2 - The method of claim 1, wherein said recognizing step (20) includes the step of 

recognizing a switch actuation. 

3. The method of claiml, wherein a match is detected in said detecting step (42) 

when the data that characterizes the second portion is sufficiently similar to the data that 
20 characterizes the first portion. 

4 * The method of claiml, wherein a match is detected in said detecting step (42) 

when a confidence measure for the comparison exceeds a confidence threshold. 

25 5 * The method of claim4, wherein the confidence threshold is adjusted in said 

detecting step (42) so that a probability of detecting a match will increase at preselected 
intervals of time subsequent to a first channel change. 
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6. The method of claim4, wherein the confidence threshold is adjusted in said 

detecting step (42) so that a probability of detecting a match will increase gradually with time 
subsequent to a first channel change. 

5 7. The method of claiml, wherein in said storing step (41), the first portion of the 

first television program is a portion that is broadcast at substantially a same time as the 
storage initiation condition. 

8. The method of claiml, wherein in said storing step (41), the first portion of the 
10 first television program is a portion that is broadcast at least five seconds prior to a time when 

the storage initiation condition. 

9. The method of claiml, wherein the data that characterizes the first portion in 
said storing step (41) and the data that characterizes the second portion in said detecting step 

15 (42) are computed based on image angles in video data. 

10. The method of claim9, wherein the computation based on image angles 
includes Delaunay triangulation. 

20 11. The method of claiml , wherein the data that characterizes the first portion in 

said storing step and the data that characterizes the second portion in said detecting step are 
computed based on audio data. 

12. The method of claiml, wherein the data that characterizes the first portion in 
25 said storing step (41) and the data that characterizes the second portion in said detecting step 

(42) are computed based on motion detected from video data. 

13. A method as claimed in claiml, wherein the recognizing step (20) includes the 
step of: 

30 accepting (25) a storage initiation command (26) from a user while the user 

receives information via the first channel, with the storage initiation condition including the 
storage initiation command being accepted. 
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14. A device for returning to a first television program being received on a first 

channel, the device comprising: 

means (20) for recognizing a storage initiation condition while the user's television is tuned 
to the first channel; 

5 means (41) for storing data that characterizes a first portion of the first 

television program in response to the storage initiation condition; 

means (30) for permitting the user to tune the user's television set to one or 
more second channels; 

means for detecting, after the user has tuned the user's television to one or more channels, 
10 when data that characterizes a second portion of a broadcast on the first channel matches the 
data that characterizes the first portion stored in said storing means; and 

means (30) for tuning the user's television to the first channel responsively to 
a result of said detecting step. 

15 15. A television receiver comprising the device of claiml4. 



BNSDOCID: <WO 0162002A2_1_> 



WO 01/62002 PCT7EP01/00514 

1/5 



33 



Y 



20A-^ 





! a/v ^ 






30 




31 




FIG. 1 



BNSDOCID: <WO 0162002A2_l_> 



WO 01/62002 



PCT/EP01/00514 



2/5 




FIG. 2 



BNSDOCID: <WO 0162002A2J_> 




BNSDOCID: <WO 0162002A2_I_> 



WO 01/62002 



PCT/EP01/00514 



16 X 



4/5 




167 




™ FIG. 3D 




FIG. 4A 




BNSDOCID: <WO_ 



.0162002A2_I_> 



WO 01/62002 PCT/EP01/00514 



5/5 



4 


1 


0 


2 


• • • 


1 



0-5 5-10 10-15 15-20 175-180 



FIG. 5A 



150-180 


0 


0 


0 


0 




0 


120-150 


2 


0 


0 


1 




1 


90-120 


0 


0 


0 


0 




0 


60-90 


0 


0 


0 


1 




0 


30-60 


1 


0 


0 


0 




0 


0-30 


1 


1 


0 


0 




0 



0-5 5-10 10-15 15-20 175-180 



FIG. 5B 



BNSDOCID: <WO 0162002A2_I_> 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date 
23 August 2001 (23.08.2001) 




,11 



(10) International Publication Number 

WO 01/62002 A3 



(51) International Patent Classification 7 : H04N 5/44 

(21) International Application Number: PCT/EP0 1/005 14 

(22) International Filing Date: 18 January 2001 (18.01.2001) 

(25) Filing Language: English 

(26) Publication Language: English 
(30) Priority Data: 



09/504,760 



14 February 2000 (14.02.2000) US 



(71) Applicant: KONINKLIJKE PHILIPS ELECTRON- 
ICS N.V. [NL/NL]; Groenewoudseweg 1, NL-5621 BA 
Eindhoven (NL). 

(72) Inventor: LORD, William, P.; Prof. Holstlaan 6, 
NL-5656 AA Eindhoven (NL). 



(74) Agent: STEENBEEK, Leonardus, J.; International Oc- 
trooibureau B.V., Prof. Holstlaan 6, NL-5656 AA Eind- 
hoven (NL). 

(81) Designated States (national): JP, KR. 

(84) Designated States (regional): European patent (AT, BE, 
CH, CY, DE. DK. ES, FI, FR, GB, GR, IE, IT, LU, MC, 
NL, PT, SE, TR). 

Published: 

— with international search report 

(88) Date of publication of the international search report: 

13 December 2001 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: AUTOMATIC CHANNEL SELECTION SYSTEM 



< 



25 

s 



43 



T 

40 



33 



25k' 



~20 



-20C 



4UH 
AN 



41A 



S 

40A 



-42A 





AN fc 






30 


s 

31 



-42 



O 



(57) Abstract: A method of returning to a program that is being received on a first channel is disclosed. The method includes storing 
data that characterizes at least one portion of the program. After storing this data, the user is free to change channels. The system 
automatically switches back to the first channel when data that characterizes a subsequent portion of the program matches the stored 
data. 



BNSDOCID: <WO 01620O2A3_l_> 



INTERNATIONAL SEARCH REPORT 



Interna il Application No 

PCT/EP 01/00514 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 H04N5/44 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 H04N 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and. where practical, search terms used) 

EPO-Internal, WPI Data, PAJ 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with indication, where appropriate, of the relevant passages 



WO 98 20675 A (IGGULDEN JERRY) 
14 Hay 1998 (1998-05-14) 
page 13 -page 40 

WO 96 27983 A (INTERVAL RESEARCH CORP) 
12 September 1996 (1996-09-12) 
page 11, line 8 -page 42 

WO 99 31879 A (DELUCA MICHAEL J) 
24 June 1999 (1999-06-24) 
cited in the application 
page 2, line 18 -page 9 

EP 0 366 001 A (THOMSON CONSUMER 
ELECTRONICS) 2 May 1990 (1990-05-02) 
cited in the application 
column 2, line 52 -column 7, line 32 

-/- 



LH 



Relevant to claim No. 



1,3,4, 
14,15 



1,3,4, 
14,15 



1-15 



1-15 



Further documents are listed in the continuation of box C. 



ID 



Patent family members are listed in annex. 



Special categories of cited documents : 

A' document defining the general state of the art which is not 

considered to be of particular relevance 
E* earlier document but published on or after the international 
filing date 

L* document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

P" document published prior to the international filing date but 
later than the priority date claimed 



T* later document published after the international fifing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underiyinq the 
invention 

■X' document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken atone 

•V document of particular reievance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

*&* document member of the same patent family 



Date of the actual completion of the international search 



29 August 2001 



Date of mailing of the international search report 

06/09/2001 



Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patenttaan 2 
NL - 2280 HV Rqswijk 
Tel (+31-70) 340-2040. Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 



Authorized officer 



Materne, A 



Form PCT/1SA/21 0 (second sheet) (July 1992) 



BNSDOCID: <WO_ 



_0162002A3_L> 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



Interna d Application No 

PCT/EP 01/00514 



a(Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category • 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



US 5 870 754 A (DIMITROVA NEVENKA ET AL) 

9 February 1999 (1999-02-09) 

cited in the application 

column 4, line 64 -column 22, line 36 



1-15 



Form PCT/1SA/210 (continualion of s 



t) <Ju*y1992) 



page 2 of 2 



BNSDOCID: <WO_ 



_0162002A3_I_> 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



Intern* jl Application No 
PCT/EP 01/00514 



Patent document 
cited in search report 



Publication 
date 



Patent family 
member(s) 



Publication 
date 



WO 9820675 


A 


14-05-1998 


US 


5999689 A 


07-12-1999 








us 


6002443 A 


14-12-1999 









AU 


5197998 A 


?Q— 0£-iQQa 


WO 9627983 


A 


12-09-1996 


AU 


5027796 A 


OQ— 1QQA 

£0 Ui7 








EP 


0872120 A 


91—1 O-IOQft 

£1 111 1?70 








JP 


11506575 T 


oft— o^-iqoo 


WO 9931879 


A 


24-06-1999 


US 


5973723 A 


?fi—i n 1 QQQ 






— . — — ._ . _ 


AU 


8589298 A 


0^—07— 1 OQQ 


EP 0366001 


A 


02-05-1990 


US 


4918531 A 










AT 


110901 T 


13 U27 1272JH 








AU 


623185 B 


07— OR— 1Q09 








AU 


4368789 A 


03-05-1990 








CN 


1042283 A,B 


16-05-1990 








DE 


68917850 D 


Oft— 1 O— 1 OOvl 

uo— iu— iyy»t 








DE 


68917850 T 


1 9—01 —1 QQC 








DK 


527989 A 


26-04-1990 








ES 


2059671 T 


16-11-1994 








FI 


89654 B 


15-07-1993 








JP 


2170727 A 


02-07-1990 








JP 


2640150 B 


13-08-1997 








KR 


161661 B 


20-03-1999 


US 5870754 


A 


09-02-1999 


EP 


0842478 A 


20-05-1998 








WO 


9740454 A 


30-10-1997 








JP 


11509025 T 


03-08-1999 



Form PCT/1SA/210 (patent family annex) <Jufy 1892) 
BNSDOCID: <WO 01620O2A3_l_> 



